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SECURITY CAMERA SYSTEM 



BACKGROUND OF THE INVENTION 

The present invention relates to a security 
camera system or video monitoring system, and in 
particular, to a security camera system capable of 
5 improving both security and privacy protection. 

Video monitoring systems (security camera 
system) taking the right of portrait, privacy pro- 
tection, etc. into consideration have been proposed, as 
disclosed in JP-A-2001-18 6507 for example. The system 

10 described in the document comprises: a building video 
information delivery module which delivers video 
information collected inside or around a building to a 
video display terminal which is placed inside or nearby 
the building; a portrait right protection module which 

15 carries out a concealing process to part of the video 
information that is relevant to the right of portrait 
or privacy; and an administration right confirmation 
module which confirms whether the viewer of the video 
display terminal has proper right or authority to view 

20 unconcealed video information (to which the concealing 
process has not been done) or not and delivers the 
unconcealed video information to the video display 
terminal when the viewer's administration right is 
confirmed. 
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SUMMARY OF THE INVENTION 

However, the system described in the above 
document, delivering real-time video information only, 
is not capable of ensuring enough security. Functions 
5 for allowing the administrator etc. to monitor 

afterward or identify a suspicious individual after an 
incident (crime etc.) took place are necessary. 

Further, it is expected that the viewer of 
the monitor video images changes depending on the 

10 situation. For example, the viewer can change from a 
janitor (at ordinary times) to security guards 
dispatched by a security company (when there is some- 
thing suspicious) , and to police officers etc. (when a 
crime took place) . Meanwhile, from the standpoint of 

15 monitored individuals, it is unpleasant to be watched 
constantly even under normal circumstances where there 
is nothing suspicious, and it is undesirable from the 
viewpoint of privacy protection. Therefore, a function 
for changing the level of privacy protection depending 

20 on the viewer and the situation becomes necessary. 

It is therefore the object of the present 
invention to provide a security camera system or 
monitoring system capable of resolving the above 
problems and realizing both the security and the 

25 privacy protection. 

In order to attain the above objects, the 
security camera system of the present invention has the 
following features . 
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One or more monitoring cameras, each of which 
transmits a digital video signal after compressing/ 
encoding, are connected to a controller via a network. 
In the controller, a media control section stores the 
5 video signal supplied from the monitoring cameras in a 
storage medium and reads out the video signal as 
needed. Image processing for privacy protection is 
carried out to the real-time video signal supplied from 
the monitoring camera and the video signal read out 
10 from the storage medium. 

The level of the image processing for privacy 
protection is switched depending on the authority of a 
user who views the video image. 

Further, even for the same user authority, 
15 the image processing level for privacy protection is 
switched and adjusted depending on the size of the 
object in the video image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other features, objects and 
20 advantages of the present invention will become more 

apparent from the following description when taken in 

conjunction with the accompanying drawings, wherein: 
Fig. 1 is a block diagram showing the 

composition of a digital monitoring system as a 
25 security camera system in accordance with the first 

embodiment of the present invention; 

Fig. 2 is a block diagram showing the 
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detailed composition of a monitoring camera section of 
the security camera system of Fig. 1; 

Fig. 3 is a block diagram showing a concrete 
example of the composition of a stream processing 
5 section of the security camera system of Fig. 1; 

Fig. 4 is a schematic diagram showing a 
concrete method of stream processing employed in the 
first embodiment; 

Fig. 5 is a schematic diagram showing 
10 examples of monitor video images after the stream 
processing of the first embodiment; 

Fig. 6 is a flow chart showing an example of 
a process for determining a processing level in 
accordance with a second embodiment of the present 
15 invention; and 

Fig. 7 is a schematic diagram showing 
examples of monitor video images after stream 
processing of the second embodiment. 



DESCRIPTION OF THE EMBODIMENTS 
20 Referring now to the drawings, a description 

will be given in detail of preferred embodiments in 
accordance with the present invention. 

First, a security camera system (video 
monitoring system) in accordance with a first 
25 embodiment of the present invention will be described 
with reference to Figs. 1 through 5. 

The following description of the embodiments 



will be given assuming the use of encoding/decoding 
(compress ion /decompression) techniques employing DCT 
(Discrete Cosine Transform) , such as the standards 
ISO/IEC13818-2 (MPEG2) and ISO/IEC10918-1 (JPEG) . 
5 Fig. 1 is a block diagram showing the 

composition of a digital monitoring system as a 
security camera system in accordance with the first 
embodiment of the present invention. In Fig. 1, the 
reference numerals "1" through "3" denote monitoring 

10 cameras or surveillance cameras, "4" and "16" denote 
LANs (Local Area Networks) , "5" denotes a controller, 
"17" denotes a monitoring terminal, and "22" denotes a 
monitor to be watched for monitoring. The same 
reference numerals will also be used in the following 

15 figures for the same or equivalent elements. 

Each monitoring camera 1-3 connected to the 
LAN 4 obtains video images from their positions, 
carries out digital encoding to the video images, and 
transmits the digital information to the controller 5 

20 via the LAN 4. 

Fig. 2 is a block diagram showing the 
detailed composition of the camera section 1. An image 
formed through a lens section 100 is received by 
sensors 101 (photoelectric conversion elements such as 

25 CCDs) and converted into an image signal. The image 
signal is converted by an ADC (Analog-to-Digital 
Converter) 102 into a digital signal, and the digital 
signal is supplied to a signal processing section 103. 



The signal processing section 103 generates a video 
signal which is composed of a brightness signal and 
color-difference signals by means of conventional 
signal processing techniques (color separation, gamma 
5 correction, etc.) and inputs the video signal to a 
compression section 104. The compression section 104 
compresses the video signal by a compression process 
employing DCT (MPEG2, JPEG, etc.) and thereby generates 
a coded video signal- The coded video signal is 
10 buffered in a buffer 105, transmitted by an interface 
(I/F) 106, and transferred to the controller 5 via the 
LAN 4. The other cameras 2 and 3 also operate 
similarly. 

As above, digital encoding (compression) is 
15 conducted by the monitoring cameras 1-3 for 

transmitting the video signals, by which the amount of 
data transferred through the LAN (traffic) can be 
reduced. 

The controller 5 show in Fig. 1 carries out: 
20 reception of the coded video signal supplied via the 
LAN 4; operation control of the cameras 1-3, R/W 
control of a storage medium 9; stream processing 
control of the coded video signal; and transfer control 
of the processed coded video signal. 
25 An I/F section 6 of the controller 5 receives 

the coded video signal transferred via the LAN 4 and 
temporarily stores the signal in a buffer 7. The coded 
video signal stored in the buffer 7 is read out by a 



coded video transfer section 30 in order to prepare and 
output a (processed) coded video signal for monitoring. 
Meanwhile, when the coded video signal in the buffer 7 
is transferred to the storage medium 9, the signal is 
5 read out by a media control section 8 . 

When the video images are played back, the 
coded video signal stored in the storage medium 9 is 
read out by the media control section 8, temporarily 
stored in the buffer 7, and read out from the buffer 7 

10 by the coded video transfer section 30 to be 
transmitted to the monitoring terminal 17. 

In the following, the operation of the coded 
video transfer section 30 will be explained in detail. 

The coded video signal supplied to the coded 

15 video transfer section 30 is inputted to an expansion 

section 10, by which the coded video signal is expanded 
and restored to the original video signal. The 
expanded video signal is inputted to an image 
recognition section 11, by which the figure and face of 

20 the object of shooting is recognized and thereby figure 
recognition blocks containing the figure or face of the 
object are determined. The recognition process can be 
implemented by techniques disclosed in JP-A-7-7666 and 
JP-A-9-134418 , for example. The figure recognition 

25 block means a block (that is obtained by partitioning a 
frame into a plurality of blocks) that contains (part 
or all of) the figure/face of the object. For example, 
the figure recognition block can be a pixel block of 



8*8 pixels containing the figure/face of the object, 
such as the MCU (Minimum Coded Unit) of JPEG and the 
macro block of MPEG. 

Information concerning the figure recognition 
5 blocks are inputted to a processing parameter control 
section 13. The processing parameter control section 
13 also receives processing level information which is 
supplied from a level control section 12. The level 
control section 12 receives user information supplied 

10 from a user recognition section 23 of the monitoring 
terminal 17 via the LAN 16, judges and determines the 
level of the user viewing the video images on the 
monitor 22, and sends the processing level information 
to the processing parameter control section 13. 

15 The user recognition section 23 of the 

monitoring terminal 17 performs authentication of the 
monitoring user based on information (password, voice 
print, fingerprint, iris image, etc.) obtained through 
an input device (unshown keyboard, microphone, finger- 

20 print reader, camera, etc.). The user recognition 
section 23, having a table associating each user ID 
with authentication conditions (the password, etc.) 
corresponding to the user ID, carries out the user 
authentication by referring to the table. When the 

25 user is authenticated, the user recognition section 23 
sends information (user ID, for example) specifying the 
user or concerning the user to the level control 
section 12 as the aforementioned user information. The 



level control section 12, having a table associating 
the user information with the processing level 
inf ormation, obtains the processing level information 
from the user information by referring to the table, 
5 and sends the processing level information to the 
processing parameter control section 13. 

By use of the processing level information, 
the processing parameter control section 13 determines 
processing parameters (specifying how each block on the 

10 stream of the coded video signal should be processed) 
and inputs the processing parameters to a stream 
processing section 14. The stream processing section 
14 processes and edits the coded video signal supplied 
from the buffer 7 according to the processing para- 

15 meters. The edited coded video signal is transmitted 
by an I/F 15 to the monitoring terminal 17 via the LAN 
16. The coded video signal received by an I/F 18 of 
the monitoring terminal 17 is buffered in a buffer 19 
for timing control, decoded by an expansion section 20, 

20 converted by a DAC ( Digital-to-Analog Converter) 21 to 
a video signal of a known standard (NTSC, RGB, etc.), 
and the video signal is inputted to the monitor 22, by 
which the user can view the monitor video images 
displayed on the monitor 22. 

25 Next, the composition and operation of the 

stream processing section 14 will be described with 
reference to Figs. 3, 4 and 5. 

Fig. 3 is a block diagram showing a concrete 



example of the composition of the stream processing 
section 14. The stream processing section 14 of Fig. 3 
includes: a Huffman decoding section 301 for decoding 
and converting the coded video signal (which has been 
5 encoded by variable length coding by MPEG, JPEG, etc.) 
to guantized DCT coefficients; a data modification 
section 302 for processing and editing the quantized 
DCT coefficients; and a Huffman coding section 303 for 
encoding the edited quantized DCT coefficients again. 

10 The stream processing section 14 operates as follows. 

The coded video signal supplied from the 
buffer 7 is decoded by the Huffman decoding section 301 
by means of Huffman decoding and thereby converted into 
an 8*8 set of quantized DCT coefficients 400 which are 

15 shown in Fig. 4 . 

The DCT coefficients 400 are composed of a DC 
(Direct Current) component and sixty-three AC 
(Alternating Current) components 411. In this 
embodiment, the DCT coefficients can be processed on 

20 the following four levels (level 1 - level 4) under the 
control of the processing parameter control section 13. 

Quantized DCT coefficients that are processed 
on the level 1 are shown with a reference numeral "401" 
in Fig. 4. The level 1, which processes the DC 

25 component 410 only, adds a constant a to the DC 

component 410. By the process, the average signal 
level of the DCT block is raised, and in an image 
obtained by re-encoding and decoding the signal, the 



high signal level can make it difficult to recognize 
what is seen in the image. 

Fig. 5 shows examples of the playback of the 
monitor video images. Blocks including the face of the 
5 object is extracted from the original image 501 by the 
image recognition section 11, and the constant a is 
added to the DC components of the quantized DCT 
coefficients corresponding to the extracted blocks, by 
which an image 502, in which the face is unrecogniz- 

10 able, is outputted as the monitor video image. 

Next, quantized DCT coefficients that are 
processed on the level 2 are shown with a reference 
numeral "402" in Fig. 4. The level 2 sets all the AC 
coefficients to 0, without changing the DC component 

15 410. By the process, the AC components of the block 

are eliminated, and in an image obtained by re-encoding 
and decoding the signal, the whole block is represented 
by the DC component (the average of the 8*8 pixels) , by 
which a mosaic-like image 503 as shown in Fig. 5 is 

20 outputted as the monitor video image. 

Next, quantized DCT coefficients that are 
processed on the level 3 are shown with a reference 
numeral "403" in Fig. 4. The level 3 sets almost all 
the AC coefficients, except the top 2*2 area 413 

25 including the DC component, to 0 . By the process, only 
low-frequency AC components are left untouched, by 
which some features of the face become recognizable in 
an image 504 obtained by re-encoding and decoding the 



signal . 

Next, quantized DCT coefficients that are 
processed on the level 4 are shown with a reference 
numeral "404" in Fig. 4. The level 4 sets almost all 
5 the AC coefficients, except the top 4*4 area 414 

including the DC component, to 0. By the process, more 
AC components are left untouched compared to the step 
3, by which more features of the face become 
recognizable in an image 505 obtained by re-encoding 
10 and decoding the signal, in comparison with the level 
3. 

Incidentally, methods that can be employed 
for processing the quantized DCT coefficients are not 
limited to the above ones. For example, it is also 

15 possible to restrict the effective area of the AC 
components in order of zigzag scan. 

In the following, a second embodiment in 
accordance with the present invention will be described 
with reference to Figs. 1, 6 and 7. 

20 Fig. 6 is a flow chart showing an example of 

the operation of the processing parameter control 
section 13 for determining the processing level in 
accordance with the second embodiment of the present 
invention, and Fig. 7 is a schematic diagram showing 

25 examples of monitor video images that are obtained by 
decoding a coded video signal that has been processed 
on a processing level determined by the flow of Fig. 6. 

At the START (601), a proper processing level 



- 13 - 

corresponding to the user's authority has already been 
inputted to the processing parameter control section 13 
by the level control section 12. The image recognition 
section 11 has already detected and recognized the 
5 object of shooting (the face of a person in this 
example) as the target of processing and outputted 
information concerning the positions of DCT blocks and 
the number of the recognition blocks to the processing 
parameter control section 13. First, the number of the 

10 recognition blocks is detected (602) and the number is 
compared with a threshold value p (603). If the number 
is smaller than the threshold p, that is, if the object 
is small enough (YES in the step 603) , the processing 
level is held intact (604). If the number is larger 

15 than or equal to the threshold p (NO in the step 603), 
the number is further compared with another threshold y 
that is larger than P (605). If the number is smaller 
than the threshold y (YES in the step 605), the 
processing level is reduced by 1 (606). The processing 

20 level is reduced by 2 (607) if the number is larger 

than or equal to the threshold y (NO in the step 605) . 
At the END (608), the processing parameter control 
section 13 determines the processing parameters based 
on the processing level which has been held or altered 

25 as above. 

Fig. 7 is a schematic diagram shows examples 
of monitor video images that are obtained by adjusting 
the processing level depending on the size of the 
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object as above. 

Monitor video images 702 and 704 are those 
obtained by processing the original images 701 and 703 
by the level 4. Even if the level 4 has been set to 
5 reveal the features of the object only roughly, the 
definition of the image becomes higher than expected 
when the object is large in the frame. In such cases, 
if the number of the recognition blocks is between (3 
and y in the flow chart of Fig. 6, the processing level 

10 is reduced by 1 and a monitor video image 705 that is 
obtained by the level 3 processing is outputted, 
instead of the monitor video image 704 obtained by the 
level 4 processing. 

By the addition of the processing level 

15 adjustment depending on the size of the object, monitor 
video images having definition suitable for the 
authority of the user can be outputted properly and 
securely . 

While the processing level was reduced in the 
20 above example, reverse level adjustment (raising the 
processing level when the object is small) is also 
possible . 

Incidentally, the controller 5 has been 
described as a special-purpose apparatus in the above 
25 explanation, it can also be implemented by a computer 
(especially, by a server) . In such cases, a program 
for implementing the above functions is installed in 
the computer, and the CPU (Central Processing Unit) of 
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the computer carries out the above information 
processing according to the program to realize the 
present invention. The storage medium 9 can be 
implemented by various storage media, such as an HDD 
5 (Hard Disk Drive) . The LAN 16 shown in Fig. 1 can also 
be replaced by a network other than LAN as long as it 
connects the controller 5 and the monitoring terminal 
17. For example, the Internet can also be used as the 
network. 

10 As set forth hereinabove, in the security 

camera system in accordance with the present invention, 
the processing of the original image can be conducted 
on various levels depending on the authority of the 
user (observer) both for real time monitor video images 

15 and recorded monitor video images of the past, by which 
monitoring ensuring the privacy protection can be 
realized. Further, the image processing of the present 
invention is also capable of realizing proper 
definition of the image of the object even if the size 

20 of the object in the frame changed, by which the 

reliability and stability of the privacy protection can 
be enhanced. 

While we have shown and described several 
embodiments in accordance with our invention, it should 

25 be understood that disclosed embodiments are 

susceptible of changes and modifications without 
departing from the scope of the invention. Therefore, 
we do not intend to be bound by the details shown and 
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described herein but intend to cover all such changes 
and modifications fall within the ambit of the appended 
claims . 



